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ABSTRACI^ • ^• 

This is the last of four reports of the Interactive' 

Group Modeling project — an undertaking designed to extend gifoup *• 

co^aunication through conpu^tWs to support the aore task- focused 

coaiuaication required by th6S€ building computer aodels. The report 

focuses on the HOB systew— a/rfys,tea that facilitates cgaaunication in 

four BOdes: computer con^5*f«n<:e«, shared visual spaces, prograa 

workspaces, and. do cu men/ workspaces. Specifically, the report 

assessed the coaaunlcaflion process in structured tests "^of the HOB 

system and prpposes a /futurct research agenda. (Fir) .'. ' 
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The Tests: An Overview 



HUB is an experimental computer-based iS^ysteon, designed to address 
conmunication problems in the modeling process, Ove* the next two years, 
'we plam to test and evaluate the HUB system with a number of user groups. 
In testing out our design, we want to see how HUB addresses c»nmtunication 
problems aijtong model builders and between builders and users, as^well as 
problems in document^^tion and validation. We know that HUB in practice 
will differ from HUB in theory. In practice, many unexpected ptoblems and 
concerns are bound to arise— technical problems of system design or specific 
effects of HUB on group conmunication. 

Before presenting HUB to user grotps, we have been testing its capabil- 
ities in a series of structured tests. The object of these pretests is two- 
fold: to exercise the system and to identify gui^&ing questions for the field 
tests. The structured tests range from artificial games to real-world prob- 
lems. While they do not address modeling problems per ser, the activities 
were all chosen with modeling and communications issues in mind. 

In order to test all of ttiL submodules, we selected four different ac- 
tivities. In the first test, which focused on the use of the program work- 
space, a gyroup leader taught other participants about a programming language 
called LISP. The Ueader had to run the LISP system smd lead a group discussion 
about it in the comment mode. The types of communication patterns produced 
might easily occur among model builders or between model builders and users. 
The second test looked again at the use of the program workspace. This time, 
the topic was a group demonstration and discussion of the NETED editing pro- 
gram. The ;third test uslj^ a simulation game called Adventure, which re- 
quired the \use of both a PLANET conference and the program workspace. Play- 
ing the game created a sequence of activities and corresponding communi- 
cation patterns that might also occur among model builders, ilie fourth 
test involved ualn^ the document workspace. Three Institute staff members 
attempted to write a paper, "4004 Futures for Teletext and Videotex in the 



.U.S//'* using HUB'S system for documentation. Again, the kind of copnuniT 
cation needed to write this paper jointly might be similar -^o thV kind * 
needed to document a model 'or to produce a formal report. 

» 

All but one of our tests were carried out in "synchronous mode, and 
all took place in a relatively short period. Also, all participants were., 
located^at the Institute for the Future. In field'tests involving model- 
ing groups, participants will most likely be geographically separated, and 
coiftnunication is more lil^ely to be asynchr^ous. Therefore, communication 
patterns may be quite different from those observed here. 

I. 

We drew participants for all these structured tests from the In&titute 
staff in order to implement this preliminary testing of HUB in an efficient 
way. Not only were willing' users immediately at hand, but the staff members 
represented a v'ariety of disciplinary backgrounds and different degrees of- 
familiarity with HUB— and computer conferencing in general. Therefore, we 
could expect to see a variety of different reactions in these tests. Most- 
important,, however , was that we could easily arrange synchronous participa- " 
tion. In these tests, the participants remained in their separate offices, 
with their own terminals, but they were ^1 using HUB at the same time. 

In exercising the system in tJjis' manner, we. have uncovered a number of 
technical and design problems-which we esjected, although not in the forms 
they assumed. The attempt to write "4004 Fixtures for Teletext" using the 
HUB system resulted in major changes ifi the software desigh of the document 
workspace. The Adv^ture run revealed a minor pr<^lem in the instructions 
for adding a program to the program workspace. Ajiother technical problem 
appeared in all of the tests in the program workspace that reQuired a change 
in the computer code. The pretests, then, resulted in important design 
changes. 

* ■* " 

Realizing that these structured tests are both artificial and limited, 
we have tried not to generalize too much from a small sample.- Yet they have 
triggered important questions. How would communication patten^s differ when 
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mentoers of the user groups came from dif^ererit institutions and perhaps 
did not know e^ch other on a pfeirsonal level? What patterns might emerge 
under asyndhronous. conri^itiort*? How much were the attitudes and ^kpepta- 
tionsiof our participants influenced by t>Ke fact t^iat HUB is an Institute 
project? ■' " ■• ' ' ':■ • 

• , The guiding question? 'we have i^dentifi^d f^^^'the fdeld tests antici- 
pate the possibilitytof dii^fere^it reactions frdfe'.futvure user groups. Our 
analysis of these structured tests- and the' insights we have gained irbm 
them wiir influence the direcli^on of 6i4 research over the next two years* 
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V:- Methpdcrf Analysfs ' ' ^"^^ ' 



In this report, we descnibe «irxd» analyze the x:bi«raunicaitJ#^n pa'ttema re- 
vealed in «h6 Structured teste. Our pfirjwr/ sountji^ of -data ab^t'^heae - -kf 
patt6bis ij5 th6^co*fferenoe transcripts; Sihpe each cwn^erence , inv6XVed . ^- 
thtee or more particjLpants, several transcripts were vay^il^OJle^^ 
We chose to^analyze the 4:hre'e most complete transcripts -i&aj: each" ttest. ^ 
Although we <lid not solicit qjj collect Responses in any systeiinatic fashi<Ml> 
we also receiv^ad several .oornments from parti cip2Uits> 



' we have developed a method. of transcript analysis tailored to th*&e * 
structured tests. We decided not to use the form of contejrit analysis th^t 
looks at each message or line 1ft tefms of |)redetermin§;a" categoHes p / 
comnuni cation i for; several reasons. Firsi, it may^ dai(^iGuit for two or 
more' analysts to. -decide what the precise defi^jClon of categpri0s like 
"procedural" or "prditJietn- solving" messages should b^.'*' Secfe, if they* do . 
settle on a definition, it may be so precise that • "tt can' ^only describe a 
very limited set of messages.* Third, it is difficult tb apply these cate- 
goi;ies oonsidlehtly since subtle changes in the content of a xJategoryi imft 
in- the flow of communication, occur constantly. 

We have chosen instead a form of analysis that gives us a broad oyeV-: 
view of the total process of communication in a conference*^ Part of this 
overview entails looking at the context in which all HUB colmunication 
takes place. The hardware is more than a part of the setting; it helps to 
shape the content of the communicatican as wipll. In order to v>se HUB, a 
person needs a telephone** and a terminal. Sinply dialing a nunber connects 
the user via TEIENET with the computer at Bolif Beranek and Newman ' 

in Boston, where HUB resides. ' \ 

The use of this hardware imposes certain conditions on conmunication. 
Any infoxinatiqn conveyed through the- system must be typed; therefore no 
visual cues or other nonverbal information will add to the understanding 
of a m^l^ge. ^ Typing also slows the pace of Information exchange. 



.Bifccauae paper-^f inting terminals were^uaed in all tliese structured tests, 
each ^jgr^r son received an immediate prii^tout, whic^ provided A recprd of ' the 
iJonference. ■ ^ . . 

, • aftalyjti^g .the transcript*-, we can view the content of a conference 

■'lie' ' • ■ '" " ■ ■ ■ 

as a series df phases, in a .developmental scheme. We dijrid^d the transcripts 
at'ihe tests inta nuihb^red entrlesr which we distinguj-shed according t6 the 
source .o|:.t^^ two consecutive messages from the 

samp person or. prog;^atn were counted as Jbe continuous entry. The appearance 
ot a message, that was not from, th^t saiie pe'rson or program marked a new 
erjjhry. -A sequence of . entries <e.g. , 1-to) forms a phase. 

■ ■■ " ' ' : ^ . . * / 

Jb each entry or sequence of entries in a phase, we wanted to describe 
'multiple facets of communication and to select facets that were particu- 
larly relevant to these conferences. ' After , reading over -the available 
transcripts, we could distinguish four dimensions of comm\inication: 

' \ ^ * ^. " ^ • Directionality \ ' . 

; •* ' ' ; • Social interactiqn 

' . ^ . Task orientation 

' * * • Reflection 

■ *■ . ■ 

in' eotploring the direction of communication, we want to know who is 
interacting with whom, or what'', in the case of a program. This study of 

irectionality can serve as^ thd basis for a network analysis of the confer- 
ence. The social dimension of communication involves processes of grov^) 
brganizatipn and individual role definition. Social relations develop not 
onay among participants JJut between the ' participants and the progran}s as 
well. The task-oriented dimension of comirtunication involves the accoii5)lish- 
ment of tasks. ' Both the participants and the program are engaged in defin- 
ing specific problems, goals, and methods. A fourth dimension of communica- 
-tion may or may not be involved: reflective comments show .how the partici- 
pants perceive their own interactions with each other and with. the conp.uter 
system. In these structured tests, reflection is a human expression only. 
Participants often comment on, their own communication patterns; the progi^suns 
do not. • 

* '. 

These dimensions of communication are distinct only in an analytical . 
s^nse. In any meesage, be it frofn participants or a program, the first 



1^ 



Wee dimensions of communication' are expressed BimultaneouslyC 

V. For eac?h preliminary test, .we examined one trau^cripi;. at,« time.* We 
divided the transcript into entries and then desfcrib^d e&ch entry .in terW^* 
of the four different dimensions of coiranunica'tion. . After ^11 A:hree'tran- - 
scripts of a conference had been described, we, pmpared them .to fin^^phases 
^ common to all. We found that in any one coAfer^pce, each partit^lpant' s 
transci^ipt di^ffered slightly frOm theWrs'. Variation in^the number of 
•entries on. a transcript was caused by the extra procedi^al ^teps dertain 
participants^ would take to run a program br' correct a mistake. Also, 
because partij^ipants -typed and sent messages at different times; they re- 
ceived messages and p^ograin^ information in slightly different sequences. ^ 

• T^he developmental scheme of the .series' of phaseS provides an overview' 
of the" process o> commuiiication in^each conference. We did not set^ut to 
look for any-universal stages of group development in computer conferencing 
or to impose theories posit^ a set pattern of group phases.* Instead, we 
tried to find processes unique to each computer conference situation, each 
with its own context, participants, and taskrf at hand. When we study a 
series of phases, a picture emerges of the development and change in com- 
munication patterns over tip^. We will now examine each^of the tests more 
closely* ^ ' 
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The Tests: A Closer look 

Wh^le the structured tests de^velcjp differently, the first two phases 

4 

are the same in all of them^ * Phase I involves GAINING ACCESS to the net- ^ 

/ 

'wotk (TELENET), HUB, and the supisys tents- of HUB. At the social level, the 
first phase is characterized by a one-to-one commiini cation pattem*b4tween ^ 
the user and the coiinputer systeitu At the task-oriented level, each user- 
faces the problem of gaining access to some conputer program. Two differ- ^ 
ent variations of this general pattern appear. • ; ' 

Subphase A begins, at the spcial level with . a rote exchange between the 
user and TELElJET. Each person must give and receive f^bm TELENET a predeter- 
mined sequence of coded information. Every user supplies the same type of 
information. While the user may or may. not understand what this code means, 
he or she does vinderstand its significance at the task-oriented level : (witho)ut 
it access to the desired activity i^ impossible. The information must be 
given correctly and in the right sequence. 

Subphase B begins when the usfer gives the command to run HUB. Unlike 

'i * * * '> 

Subphase A, Subphase B gives the» ilser the illusion of a social context. 

Therefore, this commutication is quasi-social "in nature. Al^o in contrast 
to Subphase A, this exchange is in English rather than code, question-and- 
answer form rather than rote response, and in personalized rather th^n deper- 
sonalized form. The user is asked to state his or her oym name and set a 
personal password. At the task-oriented level, the goal of establishing per- 
. sonal identity is to gain access to HUB activities. HUB prints oufwhat ac- 
tivities are available in the different workspaces. The user then must ch<iose 

whifch one he or she wants to join by entering the number of that activity. 

'it . " 

Phase II is called INTRODUCING THE ACTIVITY AND THE GROUP. , At the social 

level, communication takes place only between the user and %ie pJrogram of 

the chosen workspace, iliereford, as in Phase I, the exchange establishes a 

one-to-one relationship between the user and the <30tnputer system. Unlike 

i^hase I /however, the program dominates the interaction and sfrves to 



introduce and coordinate the group ar'b^hd a specific aptivit;^.. The program 
introduces the name of the activity in the workspace; it 'lists the names of 
all participants and tells which ones are present. At the taak,-oriented . 
level, Phase II is' distinct from Phase I becavise it involves the pro^l^m 6t 
'group* introduction and coordination rather than inxJividual access. 

^ ■ * \ 

After. Phase II, each test unfblds irt a difTerent series of phases. 
There is one featute of HUB, however, that 'begins \in P^hase 111 and' contin- 
ued^ tb a|J&ear in the fallowing phases of all the conferences. This feature 
ia programmed into all workspaces' in HUB. For each participant^, the pro- ' 
gram prints out who is currently typing, joining, or leaving the conference. 
Therefore., it provides an update of all participants' activities. A"t the 
social level, this- update allows each participant to anticipate pther par- • 
ticipants' messages. It' also serves to coordinate group' commuQicat^on by 
giving each participant an overall view of group interaction. These updates 
appear continuously from Phase III to the end of a confeijence. 

We have presented the analys-is of each test by first giving a summary, 
of the subject of the test and an overview of Its phases: This brief sxxmr 
mary page is 'followed by two graphs: . one illustrates the number of entries' ' 
in each phase; the other gives our analysis of the network of communication 
in the test. Finally, a detailed content analysis of each phase describes 
the social, task-oriented, and reflective dimensions tJf " interaction. ' 




^ *ra;sir i , ^ . 

LEARNING ABOUT •LISP 



LISP is a prograinming||lAriguage used for various projects investigating- 
artificial intelligence. Tf^is language dekis primarily, with symbolic infor- 
mation. We decide4^ that onfe staff member would try to teach LISP. to 'several* 
others-^Msin^g }$^. ajh^g* instruction wbuld serve as 4 structured test oT the^ ' 
J^insLof communication 6«^t terras thtft mi^t d^velpp wheii modelin^^ gjcpups used 

' the program vJorkspadte.'^ 'this LISP system fjinctions as a "command interpretfer:^ 
That is, it is an iit^eractiVe system th£|t accepts cgraroands from the user, 

.executes them, anid^butputs th? vresillts, , use .this system in the pitogram^ 
wSirkspace, .a program called XlSP ' was' created. Its cJnly job was to activate 
the LISP system- In particular i^ . this 'test applies to^ training in , the use 
^ of a- modeling program. In. this H:est , the org^^nizer pf,. the ' session added 

^the program LISP to the workspace . if When the 4tber^'^articipants entered HUB, 
ho, discussed IJISP nC^h them In the comment mode and then ran ^the progaram to 
illustrate its problem-solvifig' capabilities. Only the organizer could nin 
and 5^ive opmmai)ds to t'Vie pljbgram. The others vere '•looking over hip shoul- 
der" and, comment iiKf on the ihan. 



LEARNI^tG ABOUT L^SP took pl^ce at the Institute f(;^r the Future on. May 22, 
1979 0t 1:30 p'-m. , Four parti^^ants were in^tolved. Three transcripts were 
analyzed. The tfesi lasted ^(pprbximately two hours. 




PHASE I 
PHASE II 
PHASE III 



GAINING ACCESS 
INTRODUCti^G ym ACTIVITY MUD THE GROUP • 
LEARNING ^^H^GH LECTURES 

The drganizer dominates communication as he lectures 
about LISP. He take^ the role' of teacher knd others 
fall into the corresponding, role of student; '^ommurti-* 
cation is slow* and tedious.* \ 



; TRANSITION TAKI^ 'A BREAK 



PHAS& IV 



SOLVING PROBLEMS USING THE plft^RAM . ' 

ilie organizey rtins the program* to show how LISP can 
be' used to solve problems. Other participants address 
a few questions and comrtlents to the organizer but not 
to ^ch othet, ■ '\ / ' 

TESTING THE GROUP ; * . / 

the organizer\ gives the group > a ^uiz dn LISP, which 
increases group participAtion. ,The group's responses 
sue/Vest that they do not fully Ufcdercitahd LISP. 



PHASE VI ^ WRAPPING IT UP v 

The organize* decrLdes *that the session should end. 
.The others tacitly a^reij^ 



PHASE V 
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TEST 1 ■» . / 



LEABNING ABOUT LISP 



PHASE I. GAINING ACCESS 

. — _ , I 

Rote exchange with TELENET/COMPUTER. • ^ \ 

TELENET 

415 DK9 ' , ' 

TERMINAI-T165 

« 

@c 617 20c 

617 20CA CONNECTED 

BBN-TENEX 1.3^.^0, BBN-SYSTEM-C EXEC 1,5^.56 
eiOG SIMMS ^ . - r 

J, (ACCOUNT *) 

JOB 28 ON TTY160 16-APR-79 17:35 

PREVIOUS, LOGIN: 16-APR-79 17:3^ 

[JOBS 7, 29, 36 ALSO LOGGED IN UNDER SIMMS] 

Quasi-social exchange vThth HUB. 

■ @HUB 

g Welcome. . ' . 

Please type your last name (and then strike the CR key). : 

- McPherson ' '\ ' . / 

Please set a three character password. 

•• / • 

' - Mac . ' - 

Qood. Are you using a terminal that prints on paper? 

- Yes 

* 

Thank you. 

You may attend any one of the fol lowlng^iictl vl ties. 
Planet Conferences: 

* 1 Demonstration conference ^ 
* Program Workspaces: 

2 Learning about LISP 
Please ty^e\i the number of .the activity you wish to Join, 

K 2 ' 



ERIC . is 



PHASE II. INTRODUCING THE ACTIVITY AND -THE GROUP « 

When the participante choose th0 activit^^ "Learning about LISP," HUB- 
taJces them directly to the* progreun workspace. Aside, from the general func- 
tions of this phase, the program workspace also introduces the* spefcific .pro- 
gram being run^ LISP, arfd the orgflnizer who is runfting tiSP. 

• ♦ ■ • 

[Comment 1]' ,Portet\ ^Org) * 

f'll begliTby telling you a little about the programming language LISP, 

- It was Invented by John McCarthy (then of MIT, now of Stanford) for 

- use In various projects Investigating artificial Intel l.Igence* He 

- wanted a language that dealt primarily with SYMBOLIC Information, 

- rather than languages like FORTRAN or BASIC, which deal primar I ly 

- with numeric Information* LISP has some very Interesting, features 
that distinguish It from almost all other languages. 



PHASE III. LEARNING THROUGH LECTURES * 

Social. The organizer immediately assumes the role of giroup leader. 
The group apparently recognizes and aGc6pts his authority because he is the 
only one 'who knows about LISP. The leader dominates this phase o^ the in- 
struction, lecturing about LISP. , Therefore, he also takes the role of tea- 
cher. To complement this role, the other group members begin tg act like 
students listening to him and occasionally Asking him questions. The drgani- 
zer's messages are directed to the group as A whole or to the parti cipanty^ho 
has addressed him. Thp other group members tend to address their messages 
only •to the organizer {ind not to each other. 

Task^orierited . The purpose of this structured test is for the organi- 
zer to teach the programming language LISP to several colleagues. He de- 
fines the basic elements of LISP and outlines the method needed to use this 
language. He presents this information in the form of a lecture, -with par- 
ticipants interirupting to ask for concrete examples of u|ing LISP. They also 
want to know: "What can I do with it?" The organizer n4ver really answers 
this question. He puts it off, insisting that the purpose will be evident 
later. St;Lll, hi^ "•students' frustration shows in their attempt to bring up 



the question more thaa. once. Th^ degree of comprehension qf the •students in 
this phase' 
questions. 



this phase' is difficult, to assess. At least they understand chough to ask 
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/ ; {Comment 71 Pbrter(Org) , 

NdW let iTje teli«you aboijt lists. A Wit Is a group of elements 
' ' /.enclosed In pjirenthscs, with the'elements separated by one or more 

.blanks. One thing that can be an element Is any atom. ' 
• - So here Is a simple list: - 

.'-(ABC)- . > ' : ^ ' , 

- The list has 3 elements and the order of the elements Is significant. 

-Thus (B C A).Jsn(yt'Hh« same: Mst.» - /. ' , 

Now joining: SImms , 

' ■ ■ ,1 

f 

Reflective. The organizer recognized that , communication is slow.* He 
wants to keep messages short in order to ?p©ed up interaction. He" also re- 
marks that he should have typed in all introductory material before the con- 
ference actually began. The lecture-style* introduction has bpen long and 
tedious, particularly for the other participants.. 

* » 

Throughout this phase, and all other phases of the conference, the pro- 
gram workspace provides its usual updates on participant activity. 



TRANSITION: TAKING A BREAK ^ 

The organizer, who must attend to other duties, simply leaves his ter- ' 
minal and keeps the program running. The other participants log out of the 
system. At the social level,, this sequence of events reflects the degree to 
which ^roup interaction depends upon the organizer. ,The other group members 
do not continue to interact with each other over "the system. At the task-r 
oriented level, the learning process is interrupted. ^ 

(Comment 20) Porter (Org) ' 
• - Brief time out— Bob is on the phone and wants to talk to me and Mike. 

Now Leaving: Simms 

Now typing: An^lrews * ; . 

• ^-'^ 

The participants reenter the conference.. They go through Phase 1 and 
Phase II again. ' • ^ ' 



ERIC 



1 



7 



PHASE IV. SOLVINO PKOBLyMS' USING THE PROGRAM 

; Social, yhe orgjmizer ag&in is the focus of ^ the communication \proc6ss 
-(of 12 comments, 7 are made by the organizer). He directs his messages ^ 
either to the group as ^ whole in order to explain features of LISP or to 
the program in order to demonstrate how LISP works. In this direct inter- 
action with the other participants, the orgajiizer assumes the role of tea- 
cher. The program has the role of problem-solver. It ,is quite clear that ^ 
the organizer is in control. of the program and not vice versa. While as a 
teaching tool the program presehts a structure, it determines neither the 
o^er nor the direction of the organizer's communication. Meanwhile, the i 
oth^r members of the group retain their student role. They ask, the organi/:er 
about the '^y^ of certain terms and eibout^ certain responses given by the pro- 
gram. They continue to address their comments to th^ organizer and not to 
each other. - ^ . - 



Task-oriented. The organizer now uses LI^SP to solve certain problems. 
He suspends the comment mode and communicates (directly with the program, 
which prompts hJLm for a statement, the organizer Jfesponds by typing in a 
LISP expression, and th^ program then prints out the value of the expression. 
Although th^ organizer explains the value to^ the group, their questions about 
definition of terms and pi:ogram logic indicate that the group does not thor-^ 
oughly understand LI^P yet. 

[Comment 22] Porter (Org) ♦ , ; ^ 

- Now I'U go Into LI*SP and try a fpw CAR' s. Notice that after the 

- system prompts, me with - , I jyst type an expression, and it auto- 

- mat leal ly 'evalijates It and gives me the value. 



Resufhing program 
(CAR '(A B)y " 
A . / 
-(CAR '(X Y Z)) 
X 

-(CAR '(((^Xy)) ) 
((X)) 
-(CAR 



Now joining: Sfmms/((^R '((A b)) ) 



(A B 
-(CAR (A B)) 
uVd.f . 
A 



t g 



Suspending program 



[Comment; 231 Porter(Org) 

- The lines beginning with - a^e the pnes I typed (we missed the first 

- the value of the expression follows 6n the next line. The last example 

- shows what happens If we leave off the quote; u^d^f, means unbound 

•V functlon--l t 's telling us that A Is not defined as a function, so It 

- doesn't know how to evaluate (A B) . Let me know when you We caught up 

- to this point, Any questions? 

Reflective J' One pclrticip€Uit tells the others she has line noise. She 
logs out and logs in again going through initial TELENET and HUB access phases 

PHASE V. TESTING THE G^bUP * ' 

Social. The organizer maintains his role ae leader and teacher by de- 
ciding what process of learning LISP is the best: a qiliz* .The "students" , 
follow his lead. The frequency of their communication is higher than in 
Phase IV (of 27 comments, 19 are made by the group members, and only 8 by 
the organizer) . The organizer gives the participants a great deal of approval 
for correct answers and thus encourages responses « The group membj9xs con- 
tinue to direct their messages to the organizer. At the end of the quit, 
two participamts make statements to the. group that indicate a feeling of 
competitiveness. One group member misses two comments completely because 
they fail to appear gn her *t^cmscript . Consequently, ahe misses a quiz ques- 
tion and sees only a series lof non sequituirs for a while, 'the prograjJi con^ 
tinues to play the role of problem-solver. 

I- 

(Comment 50] Porter (Org) 

- Noi^ here's your next quiz question: 

- What combination of CAR5 and or CDRs can be applied to (X Y Z) to ^ 

- give the value Y? . 

Tj^sk-oriented.' The organizer decides to quiz ^is students on the LISP 

, * ■ — 

logic they have learned. He introduces the first quiz question without a 
formal watning. Two students give correct answer^; one gives ^n incorrect 
answer. At least two participants seem to havp understood, although perhaps ' 
suj)erficially, the LISP instruction. Throughout the quiz, however, all parti- 
cipants ask the organizer for clarifications. One question is unintelligible 



* " -Ik . 

V I 

*' 

to. the organizer; he says th6 content is unclear and l^tjs the question drop. 
The participant who asked the question tries to rephrase it, but ends by 
canceling the text. Another participant also cancels one of her quest:ions, 
perhaps due to uncertainty about the legitimacy of the question'. These can- 
cellations show that two members of the group were unsurte about their grasp 
of LISP .and that this uncertainty was hot communicated to the teacher. 

Reflective. At the reflective level, one participant recognizes that 
liniB noise causes the incorrect printing of symbols in LISP. This noise, 
she sees, is the source of some of her confusion about LISP. 



PHASE VI . WRAPPING 




Social.. The organizer still controls group communication. He suggests 
that they wrap up this session and begin again tomorrow afternoon. The othe 
members tacitly agree. Without c6mment, they Jog out. Leaving involves an- 
other rote exchange with the- program workspace and HUB. The organizer has 
the longest exchange, as he requests spec;lal services. 

(Comment 62] Porter (Org). 

- Maybe we'll wrap this up for now ai^ have another sessloa tomorrow 

- afternpon. I'll be able to show you more of the language now that we 

- have gotten these prel Imlnarles out of the way; Go ahead and log out, 

- then ril store the transcript. Cheers. 

Kow leaving: McPherson, SImms ' * 

Now typing: Andrews 

Task-oriented. The group now deals only witjh the problem of leaving 
the system. <Each member leaves without instructions or discussion. They 
apparently know the necessary procedures. Only one member has difficult 
comnnnicating with the V^^ogj^^* The organize-r moves from the program work- 
space back to HUB. ' When HUB a«k8 him if he wishes to ;store the transfcript, 
he responds, "Yes." He tlso asks to review the last comment and then leaves 



-19- 



• 4 ? y 



TEST 2 

NETED: LEARNING ABOUT THE EDITOR 



NETED is a simple> lirie-oriented editing program controlled by a wide 
variety of cownands, ' Teaching NETED to staff meiribers was chosen as a struc- 
tured test in*brder to ejcperiroent again with the use of the program work- 
space in HUB. This activity of simultaneously ninning and discussing a pro- 
gram would probably be a very common occurrence in any modeling effort. $fhe 
organizer of this session entered the workspace and typed out all^ his intro- 
information before other phrticipants had arrived. He ran the NETED 



ductor 




demonstrate most* of its editing features and he suspended the pro- 
d group discussions. In the program worki^ace, only one person 
an run the program; the others can observe and comment. 



LEARNING ABOUT THE EDITOR took, place at ^ the Institute for the Future on 
May 22, 1979 at 4:18 p.m. Three participants were present* All three tran- 
scripts were analyzed. ' The test lasted approximately one hour and* ten min- 
utes. ' ' • 



PHASE I 
f 

PHASE II 



GAINING ACCESS 



INTRODUCING THE ACTIVITY AND THE GROUP 



PHASE III SETTING THE SCENE ' 

The organizer comes into the workspace and enters 
introductory material just prior to the otiher parti- 
cipants' entry. When the others come i^^ they see 
these messages. ^ 

PHASE IV LEARNING THRO(jGHTiECTURES AND DEMONSTRATIONS 

The organiier describes NETED by lecturing arid run- 
ning' the NETED program to demonstrate specific fea- 
tures. • Other participants make only a few comments. 

PHASE V ^ TESTING THE GROUP 

The organizer gives a quiz on NETED^ which increases 
the other group members* level of participation. 
They direct all their messages ^ however/ only €o the 
organizer and' not to ea6h other. 

« 

PHASE VI I^liANNING IT &ETTER NEXT TIME ^ 

The organizer decidf^s that the session should end; 
things are moving slowly. Participants comment 
that it would be easier to learn if tl^ey could run 
the^ program theniselves and 4brk with only one fea^- 
ture at a time to avoid information overload. 
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NETED NETWORK: 
LENGTO OF PHASES IN ENTRIES 
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Phase I Gaininq access 

^ Phase II Introducing the activity and the qroup 

^hase III Sat ting th«, scene ? 

Phase^ IV learning through- lectures and demonstrations 

. Phase V Testing the group 

Phase VI Planning it better next time ' / 
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TEST. 2. 



NETED: LEABNIKG' ABOUT >HB EDITOR 




PrtASE !♦ GAINING ACCESS .. ' ' 

^ Rote e*kchange with TELENEO/COMPUTER. • . 

Quasi-social exchange with HUB and the program workspace* 

■ _i . , ■ ,• 



PHASE II, INTRODUCING THE ACTIVITY AND THE GROUP ^ 

Once participants en^er the activity, ^e workspaqe begins to provide 
participemt activity updates for each user. 

Porter (Org) Is runnlhg the program NETED. Do you wish to see the run also? 

- Yes •■ ■ > • 

NETED [A] run by Porter(Org) 22-May-79 7;l8»PM ^ 

Porter (Org), Sanchez are present. * ' ' 



PHAS E III. SETTING THE SCENE 

t ^ ' ' ' » • , ' ' 

Social. The organizer enters the workspace and types in several messages, 
which the other participants receive as sooh as they enter the workspace. 

Task-cfriented . The organizer's comments consist primarily of Introduc- 
ing the participants to NETED. He provides background material on vhat the 

program is and what it is designed to do. ' „ - ; - \ 

> 'Of . ^ • ■ 

^ (ComiTient 1] Porter (Org) ' 

NETED Is a simple, 1 Ine-orlented text editor. "Llr\e-orlented" means that 
the text being edited Is thought of as tonslsting of LINES, rather than 
pages, paragraphs, or whatever. NETED Is controlled by the use 6f simple 
commands. Some are Just a -single letter, such as the command T,, which 
means move to the top of the file. It Is useful to think of .the editor 
having a "polnte»" which Indicates the current position. T^hus, after the 
command the pointer Is poTntltig to the top- (beginning)" of the text. 
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PHASE IV. LEARNING THROUGH LECTURES AND DEMONSTRATIONS " 

Social. Participant interaction diyring this pha«6 is basically limited 
tp receiving information from the organizer. ThV, organizer provides in- 
,trodiv3ti6n to th^ activity as the other participants remain passive, offer- 
ing only perfxinctory comments/questions in response to^ the organizer's re- ' 
quest for acknowledgment. . . » . - - 

Task-oriented. The organizer provides* parfcioipants with background in- 
formation on how to U&e NETED editing ■ featurgff. He also demonstrates some 
features by running the NETED program. Discussion proceeds much like a class- 
room lecture presentation. The organizer presents infprmation and occasion- 
ally participants ask questions or make comments. 

9 

[Comment 71 'Porter (Org) ^ . 
30 back to the program now. ' 

. , ■ • ■ ,) ■ 

*T . . - ■ • . 

*P 1 00 

(Top of file.) . - 

Some words of wisdom: ^ ' ; 

Whoever has the gold make« the rules. \ ' [ .. 

Pure drivel tends to drive out ord inary drivel . *' 
' End 6f file cjeachec! by 'P 100' 

Reflective. One participant acknowledges his grasp of the basic prin- 
ciplea of using the editing, features. However, he indicates that? it would 
take Bome time to ^come acQustomed to using the program. i 



PHASE V. TESTING THE GROUP ] - , , 

Social. Communication now becomes more interactive; participants offeV 
more conments and aek more questions about NETED-- The brganizer responds to 
each inquiry individuaUy, generally referring to the participant by name^ 
Participants in turn direct their comments to the organizer. There are no 
comments that appear to be group responses — simply two sets of one-to-one 
interactions between the organizer and each participant in turn. The two 
particJ^pants do not exchange comments. 
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Ta9k^orient(6d; At this jioiht, tjie organizer begins to -quiz the parti- 
cipants on their xmderstanding of the previous material/ To answer his 
questions, the participants must understand the mechanics of -using ingTED i 

features. The participants' responses are hesitant or incorrect^ indicate 

^ ' ' , ' •" 

ing lack of conj^rehension., ' ' ^ \ 

>■■ . ' ' ■ 

[Comment 28] Porter(Org) " , ' 

Here's a quiz: what cftramands would. Ket me change "whoever'' to "whom- 
ever"? • 

[Comment 29] Nielsen* , ' ' ;.; 



Now typing: Porter* (Org) ^ 

[Cornment 30)« Porter (Org) | 
What I mean is, what' commands would I type in. Just typing c 
do it. \ 



Now typing: Sanchez 

[Comment 32] Nielsen 
- /whoever /whomever/ 



^1 Now typing: Sanchez; Porter(Org) 

^ [Comment'331 Porter(Org) , , ' ? 



I'll try your answer^ Mike* 



Reflectivb^ One participant expresses so(ne confusion yhen one of her 
messages stops being printed in' mid-sentence^ The organizer and other par- 
ticipants do not- Respond to her query, . . 



mPi^E VI * 'PLANNIHG IT BETTER NEXT Tf^E 

Social. -The organizer abruptly indicatfs his intention to end the 

session. His rationale for ending the session is that things are moving a 

•little slowly. Although the participants offer no objections to this de- 

cision, it is clear that they did not take part in th6 decision^-madcing pro-- 

*^ 
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ICommcnt kO] Porter (Org) 

Things are a bit slow—why don't wercafl It a day. Tomorrow or the next 
^ day, we'll try It again, but th,ls time with'one of YOU runnlng/thB^^edf- 
' • tor and n)e looking ov€!.r your shoulder (electronically). / » 

' 'T^sk-oriented. The participants' subsequent comments indicate, that they 
are s.till not very well versed in using NETED features. One participlint 
asks the organizer for a c;ijj|^jj^cation regarding the last quiz question, for 
which no correct answer, has bS!i offered.. The organizer answers briefly and 
continues with direction^ .J;g^the participants on how to leave the activity. 

Reflective. Both the^^dBjifnizer and the participants agree that the ses- 
sion might have been handled in a different way. One participant indicates 

that learning METED features may require actual running of the program Vather. 

. . . " ^ ■ ' " 

than watching as someone else demonstrates hpwit is done. She feels that 

offering too' many program features at once was. overwhelming and that working 

w^th onie feature at a time may be more conducive to learning to use the pror 

gram. * • •. 

[Cottiment 41] Sanchez • ' . " 

OK. I think Its a good Idea to wor(< with the commands one at a time 

like you were doing. Having the whoVe list print out like that Is •. 
bverwhelmlng. I think, you actually have to wQrk with It.?... , ^ 



ADV]BNTURE ' 

' 



^ 'l^enttwre Is a computer^ "^game. It was used^ as a structured test be}::^us6 
the program is interactive and GO^eful in simulating, sthall group decision- 
nWcing.i ^The conmiunica,tion' patteims involved in this decision-meUcing might 
•asily take place in modelih^^^imif^erfceB, ^In«^laying Adventure with a 
group, Jtwo typea of decision-ma)N)(ig.were necessary. Hie first .type related 
to the problem of ^choosing a group leader w This Interaction took place in 
a PLANET conference called Preparation for Adventure Here the group had to 
choose a leader^ in order Replay the gatae. Only the leader oould run and 
give coimnAnds to the game prograpi. After a leader was chosen the group 
moved to tha program workspace where AtSventure was located, then began the 
second type of decision-making, which focused oa task-oriented objectives, 
^e game program' set up a number of problematic situations that required t^ie, 
-group to decide orv- an appro^ria^te course of action. The leader would run 
the Adventure, then suspend the pjrdgramr and enter the comment mode/tp poll 

^other participants about their (Choices. The grpup had to reach ajil^mmon de-> 
cision. TheTi the leadfer resumed th^i program and gave the apprqn^ate command. 

: z : " : -^^^ ^ ^ / " 



^ * tt. Am 

Adventure was played at tne In^ititutd for the Future onwVpril 16, 1-979. 
Five .participants, were involved and. three transci;'ipts were ffiaXy^ed. The 
game lasted approximately one and one-half hours. 
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phase: V 



.PHASE VI 



Ik ^GAINING ACCESS ' 

INTRODUCING THE ACTIVITY AND THE GROUP 

V # t 

SETTING THE S( 

Group receives instruaCttmq^f rom art organizer wjjio is 
not online. 

FjBfRMlNG the; GROUP 

Multiple and subtile- rolfes develop thgt reflect staff 
, relationships. ^ Decision-^making moves quickly. An implicit 
leader suggeists a leader aifid everyone* agrees. A technical 
e^^ert urges groirf^ on to the game. ^ 

BREAKING OFF AND PEENTERItiG < H'. * 

The^^grdup moves to thd program Workspace but a problem 
arises, in runnirig the, program. ~ Th^ correction shows on 
only one transcript. - ' 

GETTING ON THE WJTH GAME *r • 

'Deci&ion-making is slow and tedious as tj^e. Iqfider s^eks 
unanimity. * . ^ 

PHASINS OUT , . ^ 

A system dif f iculty^hrises and grQup members give up and 
leave the ga^ie. ' y 
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TEST 3 
V ADVENTUKE 



PHASE I. GAINING ACCESS 

Rbte exchange Vlth TELENET/COMPUTER. 
Quasl-aoclal exchange with HUB. 



x9> 



PHASE II • INTRODUCING THE ACTIVITY AND {THE GROUP 

- ■ ' ■ i ' ' I f ^ " " ' ' . • 

The title of the activity Is: - / 
■ preparation for the adventure • ' - ^ 

The participants In the activity are: • , . 

SImms McPhersVn Porter 

Andrews AbramSy^ " / 

. ■ ■ ,A - 

Porter, Andrews, Abram^ are present* 

You have seen none of the 9 Entries made so far. Please Indlicdte 
the entry number at which you wlsh^o begin. If you dd not wish 
to see any o^the past entries, strike only tUp key^ 



SE III- SETTING THE SCENE 



Social. ix\ this play of the game, the organizer is not actiially online • 

Three days before the play of the game, the oirjganiser enters HOB eS^ leaves 

• • ^ ( ' ' ^ 

instructions about how to play the game. One \ group member enter* HUB several 

• ■ . . * -i ■ _ . 

hours before. th6' game beglAs and l^eaves a comment^n thel^e instruptions • 

When, they actually enter the game'i bther members of the group have varying 

perceptions about with whom they are commifnioating: the program or the per- 

son. ^ In any case, whatever they perceive as the < source of the message, they , 

, * ^ ^ ... 

all receive the ^me set of messages in the same order. 

Task-orientBfl . These me8sage9 from the organiser set a social task. 
8he tells the ^members of the.^roup to introduce themselves and to choose a 
group leader* Then^ she also gives instructions about the procedures needed 
to move from the PLANET conference tcT the program worklpaoe where the Adven--- 
ture game program is located* ^ 



[1] Slnims(Org) 13-Apr-79 11:03 ' . 

Welcome. I'm glad that all of .you adventurers could gather. here 

on this foggy ntgrnlng^tp seek treasures and excl tehjent. 

[2] Slmms(Org) U-SApr^yS 11 ;04 AM 

Before you "begin your adventure, J would like all of you to Introduce 
yourselves to each other and say a few things about the skills you 
bring to this expedition. 

l^] Slmms(Org) 13-Apr-79 1 1 :07 AM ' 

When you have chosen a leader, give him or her a few minutes lead 
to get Into the activity 2. Then the rest of you can Join him/her . 
there. To Join activity 2, type control P. followed by Join (activity) 
2/. Once you are there, you can talk to the leader at any time by slm- 
.Ply typing your messages. 



PHASE IV.. FORMING THE GROUP 

-Social. Synchronous group comnjunication begins at this point. Each 
inaividual shows a certain style of coirmunication related to his or her role 
in group process. The participan't who has been chosen leader hesitantly ac- 
cepts her role. She tends to send fewer messages than the others and indi- 
cates that „she is relying bn the otheJ: group members for assistance. Thrbugh 
the frequency, aggressive' tone, and directional content of his. messages, 
ancJther participant assumes the rol^e of an implicit ' leader.'' Two other parti- 
cipants quickly accede to his suggestiond.*" The. content of their messages 
shows s<W impatience and eagerness to get on with the game. One of these 
two participants assumes the role of technical expert. He tells othe^r parti- 
cipants what i)r6cedures are necessary. in HOB»to move -flrom one activity to 

anPkher* . ' > 

> . ■ * » ♦ 

You are up to date. ^ 
Now typing: Abrams \ ' 
110] Abrams f6-Apr-79 5*:36 PM 

I already have Introduced myself. Let's get the show on the road* 

[11] Andrews I 6-Apr-79 5:36 PM ^ ' 

I still have not heard from McPherson or Porter* Hello Abrams. 

Task-oriented. A decision-making process has begun. The inplicit 
leader atrongly suggests who th« leader gt the group should be. The other' 
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partici|)ants seem to aciciept his authority and concur with his suggestion^ 
A leader is cKogjen who coordinates*' group introductions Bu^ who has np clear 
plan of action. The technical expert speaks up and urges that the group 
move on to the task. The other ^members agree and follow his instructions. 

Reflective. One member notices that there seems to be an^ undue amoxuit 
of activity going on. Why, she asks, is everyone typing at once? In. face- 
'to-face interactions such activity might imply a lack of group coordination; 
while it is fxinctional in a computer conference, it may seem confusing to a 



newcomer. 



In this phase, the HUB update feature prints out who is tyjjting, joining, 
or leaving the activity. This feature continues to appear throughout all 
following phases. 



TRANSITION: ^EAfCZyC OFF AND REENTERING 



.Communication completely breaks down. Each participant successfully* 
leaves th^ PLANET conference and moves to the program workspace. At this 
p6int, however^ the program' tertninates because the instructions to * run the 
^ program had been enteJred incorrectly. B^ch participant is forced to log ^ 
out of the entir^ system. They must, tlien repeat the proper sequence of en- 

try protocols described in Phase I and Phase II. (In the meantime, tW or- 

\ 

ganizer has beeni^called in to enter theXcprrect instructions for running 
the program, ) 

[Ik] Porter 

Let's give Cynthia a couple of minutes to get Into. the game, then 
we can join her. , 

Andrews Ks running the prog.ram adventure. Do.you wish to see the run also? 
. ■ - Ves ' i . ' ' 

Adventure II ] run by Andrews l6l-Apr-79 5:'»2 PM 
Andrews Is present. 

< , 

OPENF or RNAMF: file open 
COMPATIBILITY? LOCATION -'703320 
US£R LOCATION 62060 
INSTRUCTION ■ 256000000000 



ERIC ^ 



EXIT. 

Ac 

9 



31 



> 



[Comment 1] McPherson 

- What was all that stuff I got as soon as I Joined? Included was an 
~ exitcand control c? '6 



PHASE V. "GETTING ON WITH THE GAME * ' , 

Finally, all participants have been able to get in 'and stay in 'the pro- 
gram workspace. They aje ready to j?lay Adventure*. 

' , ■ .1 ■ • 

Social. The Adventure program takes a very human form; it directly ad- 
dresses a player in a conversational tone. This program acts as both an ex- 
pert ^d a guide, describing the nature of the game and telling how to'u^e 
«the program. . ^ 'this game, only the leader communicates directly with the ' 
program. She gives the progfam the commands needed to play the game. The 
particij^nts spend most of. their time communicating with each other. One 
participant leaves to tcike a break. ^ 

WELCOME TO ADVENTURE 1 1 WOULD YOU LIKE INSTRUCTIONS? 
Yes 

SOMEWHERE NEARBY IS COLOSSAL* CAVE, WHERE OTHERS HAVE'FQUf^D FORTUNES IN 
TREASURE AND GOLD, THOUGH IT IS RUMORED THAT SOME WHO ENTER ARE NEVER 
SEEN AGAIN. MAGIC IS SAID TO WORK IN' THE CAVE. I WILL BE YOUR EYES 
. AND HANDS. DIRECT ME WITH COMMANDS OF 1 OR 2 WORDS. I SHOULD WARN 
/YOU THAT I LOOK AT ONLY THE FIRST FIVE LEHERS OF EACH WORD, SO YOU'LL 
HAVE TO ENTER "NOAthEASJ" AS ".NE" TO DISTINGUISH IT FROM ^ 'NORTH" 
(SHOULD YOU GET ^TUCK, TYPE "HELP" FOR SOME GENERAL HINTS. FOR INFOR- 
MATION ON HOW TO END YOUR ADVENTURE. ETC., TYPE "INFO".) 

^ YOU Are STANDING AT THE END'OF A ROAD BEFORE A SMALL BRICK BUILDING. 
AROUND YOU ISA FOREST. A SMALL STREAM FLOWS OUT DF THE BUILDING AND 
DOWN A GULLY. 

[Comment 1] "Andrews . . 

What does everyone suggest for the first move? 

Task-driehted. The progrAm has set up the assumptions, goals, and rules 
(or methods) of the game. It alSQ.^ts up problematic conditions and seeks 
directions from the players. Thd leader gives one-' or two-word coimtwinds to 
the program. The commands, however, result from gjroup decisions. In this 
game, it seems that the leade!^ wants a unanimous decision. She waits until 
everyone has agreed on a particular move before she gives any cojranand to the 



program, the first command is received and processed by the program/. The, 
second command is not recogniz^Oi. The leader suspends the comment made in 
.order to communicate with the progrtun. . 



PHASE VI*. PHASING-OUT 



SiDcial. The leader indicates that she' is having problems communicating 
commands to the p^greun. The participant who took the expert ro|p in Phase 
IV takes over the discussion in order to solve these technical pro|^ems. 
The leader and the other participants respond to the expert. 



[Comment 271 Andrews 
I'm having a probjem telling the program Xh&t we will take the key. 

[Comment B'il Porter 

I think you need to go back to the program with a CTRL-Z before giving 
the command. , 

[Comment '♦21 Porter • . * 

In the words of the ^astronauts ^1 think we have a problem.'' 

Now leaving: Andrews , % ' 

i 

[Comment ^'♦l McPherson 
- Shal 1 we a1 1 leave? 



w 

' Your current participation Is ended* ^ 

Task-oriented. The expert finally acknowledges* that a real problem 
exi'Sts. Each participant then logs off the system Individually with no 
apparent discussion. (Actually, the conference organizer goes to ^ach^^ar* 
ticipant's otfice gind a^ks him or her to end the session.) 

1 ■ 
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^ ' TEAM WRITING 



ihe dociiment workspace In HUB provides an environment In whlcH a group 
of people *can jointly write an/ edit a rejpoit, pap^r^ or other docximen't* A 
test of this use of. the dooument wor]f space was attempted over a period^ of 
three weeks. The objective was for three members of a research team to^ write 
^ conference paper on the future of teletext. One meihber of the team wrote 
the first draft in the document workspace and others were encouraged to work 
on successive drjifts by using the EDIT service in t;he dociment workspace* 
This produced the following type of tr£mscript: 

The title of the document Is: . - * * 

IEEE Paper . 

' The participants In the activity arex . . 



Porter ||)up Nielsen 

and the document Is stored in the file: . 
IEEE.TXT 

You' have not seen .1 commenl;s and 9 changes, made since* l-liay-79* Please 
Indicate the date at which you wish to begin. If you^do not wish to 
see any of the past entries, . strike only the CR key* 

- l-May-79 

PAGE 1 LINE 16 Porter (Ong)' l-May-79^: 59 PM INSERTED , ' 

In AhU paper we address the following question: What jare the ikey 
issues surrounding the development of teletext and viewdata In the |>S.7 
Some of these issues comerreadl 1y to mind, such ai the adoption of I 
standards. Our thesis, however, Is that the number of Issues Involved 
is in fact large, and fhat taken together they represent a great deal 
of unoertalnty about the future of teletext and Viewdata In this coun- 
try. . ■ . 

PA'GE 5 LINE 37 Porter(Orff) 3-Mayr79 ^:22 PM REPLACED , • ' 

also provides- access to Information. Rather that a passive medium, 
today ' ' ' / 

WITH . ' 

also pr6vides access to Information. R/tther ^han a passive medium, 
^oday's ^ f 



This test was not a structtire^ test like the previous thxee test^; it 
was a test of the system for a real problem, it also encoujg.tered a number 
of fundamental communication problems that led us: to redesign the document 
workspace. Vte have thus not analyzed it as we have the structured tests; * 
we^do, however, want to note the changes that it inspired in the document 
workspace. -.^ v.V.-n 

The design of the document workspace proved too cumbersome. First, 
there was not a clear focus on the editing process. Changes were unnumbered 
and difficult to retrieve. Coiranents, on the other hai;id, were numbered./ 
This created competition for the focus between an ordered transcript of com- 
ments and a less ordered series of* changes. In the revised workspace A the 
changes are numbered amd comments are attached to changes <that is,, they ap- 
pear nepct to. and reference the change to which they refer) . ; 

Another problem that arose in our initial design was the length, of changes 

♦ 

We had not anticipated the long insertions that, in fact, occurred in this 
testt A participant, reviewing changes, would be ext)ecting a quick review 
of changes •'amd 'find instead that one change was l^ive pages' long. Thus, we. 
have given users the option of seeing a summary of changes: if a change is 
ten lines or less, it is printed in its entirety; if it "is more than ten 
lines, only the first line is printe#. 

Another design modification concerns sorting of .changes. Originallyi 
cl\anges were displayed in the order they were made. Now, they are sorted 
by page and always displayed with, other changes on the same page. 

Finally; we have added a duiranary of changes for each session. Since 
the cKangeB are not actually numbered until the session is complete, it was 
not -possible to attach conments to one's ovm changes. Now the user <:an get 
a, list of numbered changes and make C9mmen€tf on these changes as. conclu- 
sion of an editing "session. * \ 



A Research Agenda* 




In the pirocess of. analyzing ^these structured tesjts, we have looked 
<• ■ . ■ . 

closely at the hardware, the social processis, the tasks, apd the partici- 

pants' own reflections on their ejcperi^nce with HUB. Our analyais, raises 
several issues about the ways in which the HUB system might influence, 
whether directly or indirectly, tjhe' communication patterns of groups in- 
volved in coirputer modeling. Major isjsues include:' tl^ distinction be- 
tween information exchange and xinderstemding of thajt information, |he flow*^ 

of information in, the HUB system, the development of social roles in HUB, 

" ... 

the social role of the HUB systeft itself^ and the reliability of cbhmiuni- 
cation. These issues provide an initial agenda for our research over the 
next "two years. " 

ISSUE 1. INFORMATION EXCHANGE VS. UNDERSTANDING ' ... 

Our structured tests have brought out an inqportant distinction to be 
made in analyzing communication via any system: a system's capacity to in- 
crease the jamount of information e35chancM cannot siinply be equated with 
its capacity to promote the genuine understanding of that information. 
This distinfction was central to our objectives when designing the HUB sys- 
tem: we wanted' tp develop a system that would provide access to more com- ^ 
puter resources for more people. And at the same time, we wanted a striic- 
ture that would help people to better understand t^ose psources. 

The two structured tests dealihg with instruction hint at- some ok the 
problems that might arisev in using the HUB system to promote understanding 
of t6mputer-ba»ed resources in modeling, in both the LljgP and NETED tests, 
a great d«al of teohnioAl tMormation wa« presented. One might assume that 
this type of material would be more easily digested along with the real- 
time demonstration of the programs being explained. ' However, the paa^icl- 
pante seemed to understand relatively little at the end of the teste! 



Several factors in tlje "style" of using the program workspace may account^ 
for Hh^s: the speed of presentation, the lecture-style format, the lack of 
hands-on interaction with the program, and the brevity of the test. In 
both tests, the organizer ran the 'program as a demonstration tool. Most 
information was given either by the organizer or the program. The olRer 
participants addressed their questions and comments only to the organizer; 
their participation was minimal. , At the end of the NET^D test, participants 
noted that. they mi^ght have learned more if they could have had a more active 
role in riinning and interacting with the program' themselves . One partici- 
pant in NETED also ^ggested that dealing with only a small amount of infor- 
mation seemed a better way to learn 'the NETED cbmi^ds. This may simply be 
a pjroblem of inforiaatdLon overload,, related to the synclvtonous use of the 
system m the tests. Increased partipipation may have helped; tl>e quizzes 
the organizer gave in both LISP and NETED -^seemed to intfrease the^^group's ^ 
participation, as .well as their vmderstanding of the information presented ^ 
to them. <i ' 

» . f 

The quiz results are misleading, however. In spite of a majority of 
correct answers in the LISP test, for example, the participants ea^pressed 
confusion about. the overall process of using LISP, including a basic lack 
of understanding! about what, it might be used for. This raises a fundamen- ' 
tal concern for us— HUB might actually obscure a IHck of understanding when 
it exists. 

No commvmication sys^t^m can ^fuairantee thal^ its users' will understand 
each other. But the structured tests have suggested some specific patterns 
for us to watch for as we test the HUB System over the next twd"y#$rs* 



THINGS TO WATCH FOR: 
INFORMATION. EXCHAflGE VS. UNDERSTANDING 



• The potential of HUB to obscure a lack of understanding when 
it Exists. 

• ^tter «lnderst?mding when discussion is less structured. 
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• Coimnuni cation that focuses on the technical details of the 
modeling, process but not on underlying assuirptions . . ' 

*• hub's tenden-cy to foster the "selling" of one perception 
rather than a cpinparison of a variety o:g, perceptions. 

• Information overload in synchronous uses of the system, ^ 

Discussions that raise a lot of issues *trt do not resolve 
then^to anyone's satisfaction. 

• Better understanding when participants all have direct inter- ^ 
action with programs in the program workspace. 

• 'Si^'^^S^^fPf HUB to "achieve a false consensus. 

^ • Better understanding with group discussion than with str^c- 
turec| teacher-to-pupil communication i 



ISSUE 2; Tltffe FLOW OF INFORMATION 

f r — ^ ^ . 

♦ . The f^ow of information in any communication environment -can be mea- 
sured in^t|rins of : the pace ^ of communication and the integration of infor- 
mation, tfh^ exchange of information- among different activities and different 
roles withfin those activities, the incorporation of informatiqp from outside 
of the imme^^ate environment, and the processing of this information. One 
objective' of W HUB design was -to promote the integration of irlYormation 
from the many activities that cqnatitute the modeling process. Our previous 
experience with PlEANET conferehces^most often leads to a diverging flow of 
inf ormation| -hence ,\its value for activities such as brairfs terming. However 
in the HUB System, we ':^oped that the workspaces would" facilitate the inte- - 
gratlon process by focus^g the flow 6i information on a program or a work- 
space; we al4p hoped that tl^e HUB "switcher"v4*ould serve to intejgra^e acti- . 
vities. . ^ 

Of our st^ructured tests, oniv the AdVentvure test- involved both a PLANET 
(Conference and a program workspace .\ Because this W5^s,a synchronous test ih 
which the participants were instaructed^to accoitplish- certain tasks in PLANET- 
in preparation for the exercise in the ^graAi workspace, we could ea^ect a 
high level of integration of the inforrtiati^sm in the two activities. Moit 
of this information, concerned role definitioh; and the use of the systems 



two rolea tKat were defined in the PIANET conference (group leader and tech' 
nical ejcpiirt) were transferred without furth^J: discussion to the workspace. 
JVXflb, evejryone entered the workspace with the same- information about the 
activity to occur there. 'The transition was not smooth, du^ tk technical i 
problems, bu^ these problems did not inhibit the flow of information. In 
real-world tests, of course, we might expect a wide variation in fldw cff 
information. , • , • ' \'' 

In ali thre^ tests, the flow of information between the program being 
run and participants using the program was' fvinneled through a singly person. 
Yet in the Advelpture test, there was much more exchange of information 
among all the participants than in the two instructional t^Bta. This pat- 
tern may be linked to (1) the group task, (2) the leadership style, and 
(^) the type of program being ^sed. We suspect that the characteristics of 
the computer programs .used in HUB will play an inportant role in the inte- 
gration or lack of integration of information. For' example, many of the 
programs designed to support struc^tural modeling may prove' to integrative 
However, one task /or us in our field tests will be to define better those 
charactefristics of programs that tend to «foster integration. 

'Regarding pace of communication, participants in all the structured 
tests complained both (during and after their sessions about the 'frustration 
of communication "in slow motion." The fafcts that most users were not ' 
skilled typists, that the output s;peed of the terminals is fixpd, and that . 
transpdssi^n of a message does not begin until the messagfe has been conplete 
ly typed all help to explain the perceiVed Slow pace of communication. At 
the same time, it is worth pointing out that ' this -perbeptipn of slow commu- 
nication in HUB is actually a relatiVte judgment." In all these structured 
tests, communication was synchronous. Therefore, participants might instinc 
tively compare HUB with other more familiar forms of Bynchronous interaction 
suqh as face-to-face, or telephone conversation. In asynchronous -communica- 
tion, or in synchronous cortmunication in which the prograitv pjlays a more 
active roltf in generating information, the pace of conmuni cation may be per- 
ceived differently. 

A flnAl qijiestion relatedl to information flow arose in the course of 
the structured tests: . What sitops the flow of information ih HOBP How do ^ 
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sessions end? In Adventure > the geune endpd due to system failure. In LISP, 
and NETED, hqwever, the organizer s\*ggested endinjr the sessions; ^*irtially ^ 
because of the slow pace of communication. Althoi^gh a computer-bffsed medlxim 
of communication is, supposed to relieve the time constraints of fAoe-to- 
face meetings, it may .Have time constraints of its own. And these time 
constraints may ultimately halt, the flow of information in HUB." 

The structvured tests have provided hints of the pattern? in, the flow 
of information in HUB — hints that suggctst some items pur research agenda * 
should include. < * ' , 



THINGS TO WAJTCH FOR: _ • ^ ' - 

r , THE PLOW OP INFORMATION' ' " ' y 

* • ' SI 

More integration of information among activities when synchro- 
nous communication is emphasized. 

Moife division of information aroon^ workspaces wh^n asynchro- 
nous communication is enphasized. * 

■ % 

A greater tendency for information 'to be funneled through one" 
person when commiinication is primarily synchroipous. , 

CI* ' . 

* ■ V ' * 

In asynchronous uses of the system^ a tepdency for the program 
to generate more information than do people. 

A tendency for one person to doi^lnate the flow of information 
if he or she is more skilled in the use of the 'program. . L 

Iiess structxired flow of information among participants whep 
the program is simple and highly specific. 

Mor'e structured flow of information among participants with 
conplex, general-puTRpse programs. . ' 

A tendency to perceive the pace of communiication as s](.ow when 
information flow fr6m the program to the gx^oup is low; a ten- ^ 
dency to perceive the pace of communication as fast when the 
program generates a lot of information; 'and a tendency for 
^ihese perceptions to be exaggerated in synchronous communica- 
tion. 



f ISSUE; 3 1 THE DEVgLOPMENT QF SOCI AL ROLES *' • *' ' • > , 

" jThe developaient of japcial roles is crucijpl to the modeling process 
becaUM such roles will determine who shares what infoijination with the 
grbup and how decisions about, the use of this information ^ire made.' • The 
roles Adopted will infiluence both the flow of inform^ition and the degree to 
which that informatj^on is understood, ri)JB was designed allow people to 

» ■ ■ ' ' ' ' ' 

express -themselves in a variety of different^ rples and to develop and change 
these roles^ This flexibility in group process is necessary if HUB is to 
help" overcome s6me of the social barriers in 'modeling that arise among indi- " 
yiduals who are. from different institutions and different disciplines an|4 
who have different habits, of social interaction. 

^ / . Our developmental ,mode of analyzing, the structured tests has proven 
"well suited' to questions of •social roles. By studying each ^ase, we have 
been able to see what roles existed. By studying each series of phases— 
taie^dfvelopmental scheme— we have watched thes^ roles change through time 
in a particular* situation, ■ 

♦In the Adventure test, we found a variety of roles developing in Phase 
IV in PLANET: an implicit leader, a" chosen leader, a technical es^eft, and 
a ^jjJllower. . To soilfe extent, ''these, roles reflected the work relationships 
♦mong these participants at the 'institute. In NETED and LISP, hoyever, 
roles were not as numerous: in_ all phases, ^here were a teacher (the organ- 
izer) «md students" These students did not create new roles wh^ interr 
acting with each other. Unlike the roles formed in the Adventufe game, . 
tho^e adopted in the LISP and NETE;p teste. did not reflect n</rmal relationships 
among the staff members. The structure of tl\e HUB activity mAy influence 
■the natuTi of social roles. The PLANET conference used in preparation for 
the Adventure game, which seemed to enciHirage a variety of roles, created a 
very unstractvCred ei^ivironment; the more structured program workspace used 
in. the LISP and NETED 'tests ♦produced a. more rigid pattern of ^ihteractions. 

'. The question of change .and development of roles also f^tbae in the struc- 
tured .testjir In LISP nnd NE:ped, we. saw very little change ih the initial 
It^Jipher-rstudent hierarchy established in the early j^hases of the session. 
];in^X<ilv«ntur«, .however, we folind two distinct patterns developing. ' In Phase • 
IV,. fQnnlhg^A Group, *an. a^taost autocratic hierarchy existed. Essentially 



dh« petaon, the dnpliqit leader, seemed i:o Influence roost of the xleclslons. 
•et tater. on, in Ph«oe V, Getting on With the Game "a more "democratic" 
set bif relations deveibped Vhen the chosen leader took charge. This shift 
in role relations Wjis' essentiUlly determined by a change in Ijeadership— a 

•* ■ . . . , ' . '•• . • 

Shift that. wtiB the result of the chosen leader's special access to the 

J-: : '•■ t/:' ' , . " • 

Adventure program. <■ '-V; i ■ ' * 

•' ■ > ^ ' . ■ ' • 

In future fieild tdsts, we intend tp watch how rplesi and consequently 
role relations, Chang*. As a "starting point, we^[411 fcay i()articular atten- 
tion to possibilities the* pretests haye sugges<ied., " 



THINGS TO WATCH 'FORi 
THE DEVELOPMENT OP SOCIAL ROLES 



• Greatef variety of roles in PLANER than in the workspadefe. 

» • ■ ■" \ ' ' 

• different roles in different activities. 

• A tendency f6i-;% _ technical ej^pert to takp a leadership rol^ if 
the program is di#ficult to use. 

• A tendency for conflict to arise between the technical expert' 
qua- leader and the formal leader "of ,the project. 

• A tendency for roles to be defined .'jpiy access to a program. 

Pifficulties in maintaining a leadership role if ev^iVone has 
knowledge of and access to the program being used. 

" . ■ « 

• More structured reies.and role relationships in synchronous 
than in asynchronous communication • 

* ■ 

• .Greater variety of roles when the program is simplf and speci- 
fic; a tendency for •k.single dominating role with conplex, 
^enerai-purpose programs. 

• Likelihpod that roles and relationships formed outside the 
•context of riUB will be mojre <?aslly recreated in PIAHET than in 

the program' wot-kspace. . 

• Likeli-hopd that tt^l^ey^lopinent of rbljBs and reUtionehips in , 
HUB< Will follow a different process according tv^ whether parti- 
cipants do or do not already know each other. t- 



'A 
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, ISSUE 4 . THE SOCIAL ROLE Of TH» HUB SOFtW)UtE • 

We tried to ilealgn HUB to be ae tVan«parent as possible; we wanted 
people to. feel that they, were communicating within a giroup rather thah 
' ^ with a computer system. At the same time, we hoped HUB would structure 
. oommunipation in- a way that would both , encourage participation and guide ; 
people through complex actiVitiesl These objectives adght seem almoiit ^ 
mutually exclusive. However, we have attempted to achieve thelw by design- 
ing a system that structures commuAic^dton in ways, that would be analogovts 
- to, more familiar forms of human interaction.. Our hope was that particiipanta 
would not find these structtites disruptive in interpersonal communication. 

The HUB system appears to play specific roles in structuring communi- 
caUon. In Phase I, or Gaining Access, when TELENET' demands a mechanical 
exchange of coded information, the i^er is probably very much aware of inter- 
acting with A„computer system. In th6 second patt of Phase I, however, HUB- 
^ creates a more "human" exchange, in Phase II, the workspace program chosen..- 
*, plays the role of a group coordinator. In Phase III of some tests (Setting 
the Scene), the review feature of HUB can^be perceived either as direct 
communication •»ith- another particip^t or as communication via a computer 
program that is "reporting* what other participates ^Id. Finally, *we 
should emphasdzt one more feature oif HUBt ' tlje cont^ual updates of parti- 
• cipant activiiiy. Our analysis o^the structured Ij^ts suggests that these 
updates tend to increase each participant ' s . awajreness of communicating with 
a group.. These updates give participa^its information in "verba'l" form that* 
is often expressed in nonverbal form in ordinary face-to-face interaction. 
For exati«>le, they signal who is about to send a message, who is joining the 
group, and' who is planning on, leaving. In an inconspicuous way, these up- 
dates add another dimension to HUB communication > aside, from just Mndii^g. 
and receiving irtessages one at a time, each participant Wtinually receives 
Ihformation about the total ^rroup. This function of HUB extemallEes some* 
thing that is normally done interhally— and •v»n»subo6risoiou«ly— by .each 
individual. , . - ^ , ♦ , 

The iwpottance ^ the social role of ^ HUB soUware in the^W)deUngtpro- 
©•Ipl^* unknown. We siispect that it might N^nfluence users' pero^tioni . 
of the credibility and accessibility of the yarlouiTa^lvitleg . It might 
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^3 , 



also- Influende users Vsparbaptions of thalr responsibility in carrying out 
those activitlea. 'rrom the limited data ^of these preliminary t;estp\ we 
have made some speculationc^ 

, *' >. • ^THINGS TO WATCH Jp5R: 

THE SOCIAL ROLE OF THE HUB SOFTWARE 



• More conscious attention to group process as a result 'of 

information provided by HUB* 

• » ■ t • 

% 

• A tendency to think of HUB as a hnman-like participant cap- 
able of initiating — and therefore taking responsibility for — 
some of the activities. 

- I, . . , 

• A tendency to assume that HUB will "manage" the communica- 
' tion process', with frustrations arising when It does not. 

• A tendency for users to "blame" HUB for limits on the flow*" 
of information that are actually imposed by style decisions 
of the users (or ohe of the users) . • 

• A belief thAt HUB does not influence the understanding of 
information. . ^ e 

m Different roles for HUB in different situations; HUB will 
probably be most conspicuous as a social actor in synchron- 
ous communication. 

«- * * / 

ISSUE 5t RELIABILITY OF COMMUNICATION ^ ' ^ 

How people perceive the reliability of the HUB system will greatly 
affbct how much it ^Ls used, when it is used, how information exoharigect in 
HUB is pieroieved, and how reliablfe |the social relationships maintained in. 
HUB seem to be for the task at hand. In choosing a computer operating sy^- 
^t•m, our objective was to find one with as few restrictions as possible for 
Interactive cbmrounication. Therefore, we ii*pl*mented^ HUB under ^TENEX on a 
PDP>10 computer at Bolt Ber«nek and Newman in Boston (a6^es8ed through 
TELENET). .Thilpughbut the Structured tests, we were cpntinually reminded 
that in making thif choice we had achieved flexibility but sacrificed reli- 
ibilityl ' • . . / ^ 
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The network's lack of reliability did Affect attitudes toward cownu- 
nication in HUB. Participants in the structured tests found the conputer's 
unpredictable behavior frustrating and inconvenient.. It also influenced 
the development of a social role: ^ the technical^ expert gained considerable 
power as a result of system failures. , " ' 

Although the role of the transcript was never directly discussed by 
participants in the structured tests, their perceptions of reliability of 
HUB coiranunication may be enhanced by the availability of transaripts. Re- 
gardless of disruptions that might occur in the process of communication, 
users can .always turn to a transcript to find a record of what has gone ^ on. 
This record allows users to confirm, synthesize, and reflect on the infor- 
mation exchange through HUB. When a paper-printing terminal is used, these 
•transcripts are immediately available. If a terminal that displays the 
interaction on a screen is ueted, a transcript, can be requested through the 
review procedure in HUB. 

Based on our experiences of the retliability of communication in the 
structured tests, we expect certain patterns to emerge with future use of 
the.HUB JVstem. ' , 



THINGS TO WATCH FOR: 
RELIABILITY OF COMMUNICATION 



• More status for ttchnical experts when sy^em reliability is low.' 

• improved perception of reliability when a technical expert is ' 
present. 

. . ' 

• lower credibility of the computer programs being used when system 
reliability is low. 

f : 

• improved perceptions of reliability when iuteraotion is predomi- 
nately asynchronous; poor perceptions, of reliability when it is 
primarily synchronous. 

- A tendenoir for pej:ceiv4d reliability to inprove as users beobme 
more ej^perienced. , 

« ' * ."it... 

f ■ ■ ■ 
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• A proportional relationship between the perceived reliabillt]^^ 
of the system and tKe frequency of its use. 

m More eniphaslB on^^problem solving ^ opposed to "nQtepad" uses 
of the system when perceiyefl reliability is high. 

• Iirproved perceptions of reliability when the group uses the 
REVIEW feature frequently. 

• A tendency for those who are unfamiliar with the substantive 
issues of the activity to be more concerned about -reliability 
than those who are very knowledgeable. 



AN AGENDA- IN-PRdGRESS 

The purpose of thesa preliminary tests has been to ptovide a focus for 
our research over the next two years. Thp five issues discussed above con- 
stitute such a focus — an initial agenda for our research. But even before 
we begin to observe the use of HUB by modeling groups, we realize that this 
focus is, perhaps too narr<^w. '^The structured tests were designed to bring . 
out communication issues primarily; but our overall analysis will also need 
to include issueia of model:^ng^met/)odology. Also^ we suspect that several 
other issues vfil\ emerge once we step into the "real world. And the list 
of "thing6 to watch for" in each issue will expand, too. ..ThufiL^our research 
agenda is an agenda-in-progres?. Our approach to evaluation wilk be con- 
stantly to revise our concerns and expectations as our experience grows; we 
feel that this "evolutionary" design will ultimately provide a very rich 
picture of effective and ineffd^ctive ways to use HUB in the modeling process 



